Volumetric kombat:a case study on developing a VR game with Volumetric Video

This paper presents a case study on the development of a Virtual Reality (VR) game using Volumetric Video (VV) for character animation. We delve into the potential of VV, a technology that fuses video and depth sensor data, which has progressively matured since its initial introduction in 1995. Despite its potential to deliver unmatched realism and dynamic 4D sequences, VV applications are predominantly used in non-interactive scenarios. We explore the barriers to entry such as high costs associated with large-scale VV capture systems and the lack of tools optimized for VV in modern game engines. By actively using VV to develop a VR game, we examine and overcome these constraints developing a set of tools that address these challenges. Drawing lessons from past games, we propose an open-source data processing workflow for future VV games. This case study provides insights into the opportunities and challenges of VV in game development and contributes towards making VV more accessible for creators and researchers

A signaling visualization toolkit to support rational design of combination therapies and biomarker discovery: SiViT

Targeted cancer therapy aims to disrupt aberrant cellular signalling pathways. Biomarkers are surrogates of pathway state, but there is limited success in translating candidate biomarkers to clinical practice due to the intrinsic complexity of pathway networks. Systems biology approaches afford better understanding of complex, dynamical interactions in signalling pathways targeted by anticancer drugs. However, adoption of dynamical modelling by clinicians and biologists is impeded by model inaccessibility. Drawing on computer games technology, we present a novel visualisation toolkit, SiViT, that converts systems biology models of cancer cell signalling into interactive simulations that can be used without specialist computational expertise. SiViT allows clinicians and biologists to directly introduce for example loss of function mutations and specific inhibitors. SiViT animates the effects of these introductions on pathway dynamics, suggesting further experiments and assessing candidate biomarker effectiveness. In a systems biology model of Her2 signalling we experimentally validated predictions using SiViT, revealing the dynamics of biomarkers of drug resistance and highlighting the role of pathway crosstalk. No model is ever complete: the iteration of real data and simulation facilitates continued evolution of more accurate, useful models. SiViT will make accessible libraries of models to support preclinical research, combinatorial strategy design and biomarker discovery

Dense agent-based HPC simulation of cell physics and signaling with real-time user interactions

Introduction: Distributed simulations of complex systems to date have focused on scalability and correctness rather than interactive visualization. Interactive visual simulations have particular advantages for exploring emergent behaviors of complex systems. Interpretation of simulations of complex systems such as cancer cell tumors is a challenge and can be greatly assisted by using “built-in” real-time user interaction and subsequent visualization.Methods: We explore this approach using a multi-scale model which couples a cell physics model with a cell signaling model. This paper presents a novel communication protocol for real-time user interaction and visualization with a large-scale distributed simulation with minimal impact on performance. Specifically, we explore how optimistic synchronization can be used to enable real-time user interaction and visualization in a densely packed parallel agent-based simulation, whilst maintaining scalability and determinism. We also describe the software framework created and the distribution strategy for the models utilized. The key features of the High-Performance Computing (HPC) simulation that were evaluated are scalability, deterministic verification, speed of real-time user interactions, and deadlock avoidance.Results: We use two commodity HPC systems, ARCHER (118,080 CPU cores) and ARCHER2 (750,080 CPU cores), where we simulate up to 256 million agents (one million cells) using up to 21,953 computational cores and record a response time overhead of ≃350 ms from the issued user events.Discussion: The approach is viable and can be used to underpin transformative technologies offering immersive simulations such as Digital Twins. The framework explained in this paper is not limited to the models used and can be adapted to systems biology models that use similar standards (physics models using agent-based interactions, and signaling pathways using SBML) and other interactive distributed simulations

SiViT

The Signalling Visualisation Toolkit (SiViT), is a cancer cell signalling network visualisation tool that provides an intuitive games-based real-time interactive interface to models of cancer cell dynamics. SiViT provides a games-technology approach to unlocking the complexities of cancer cells to anti-cancer drugs. SiViT can load a wide range of biological models in the form of SBML, but the work focuses on the Abertay Cancer cell model. SiViT allows clinicians and biologists to directly interact with the cancer cell model, introducing drugs or mutations. SiViT animates the effects of these introductions on the internal elements of the cell pathways and nodes. Showing how the cell network responds to these introductions such as increased or decreased activity, or re-rerouting to bypass the effected region of the network. Indicating the effectiveness of drugs, drug resistance and suggesting area for further experimentation.Offering bi-directional interaction and explorations. With drug inserts updating the model in real-time. Timings of drug introduction or mutations is crucial and SiViT allows for changes to occur at specific timings and model the result. This is critical in the exploration of combination therapees. SiViT follows the visual guidelines from existing literature on cell networking and dynamics, with ongoing HCI work being conducted to ensure information is visualised accessibly. SiViT was part of the UKRI Main Exhibition Stand at the American Association for the Advancement of Science 2019 conference. SiViT was the catalyst for a new 4-year project led by Macmillan Cancer Support on optimising health and social care service provision through interactive network visualisation.<br/

Hardware and software supporting physiological measurement (HSPM-2022)

This workshop addressed scientific research and development to acquire physiological signals, process signals, and extract relevant data for further analysis. There are very different domains of application, for example. Tiredness and drowsiness are responsible for a significant percentage of road accidents. There are different approaches to monitoring driver drowsiness, ranging from the driver’s steering behavior to in-depth analysis of the driver, e.g., eye tracking, blinking, yawning, or Electrocardiogram (ECG). One of the leading causes of road accidents in Egypt is trucks, buses, cars, motorcycles, and pedestrians, all sharing the same infrastructure. The result is that there are more than 12,000 fatalities in road accidents every year. Thousands are injured, and some suffer long-term disabilities. A similar effect can be observed in Germany for all types of vehicles. According to the Federal Statistical Office, a high percentage of accidents involving personal injury are directly or indirectly caused by drowsiness. A different application domain is sleep monitoring: Healthy and sound sleep is a prerequisite for a rested mind and body. Both form the basis for physical and mental health. Healthy sleep is counteracted by sleep disorders, the medically diagnosed frequency of which increases sharply from the age of 40. Increasing acceptance can be promoted by monitoring vital signs during sleep over long periods through the exclusive use of noninvasive technologies. In the case of objective measurement, the vital signs are measured to calculate the sleep phases or sleep efficiency and, after applying the appropriate algorithms, to record the sleep quality. About a quarter of all Germans have the feeling of sleeping poorly. The disruptive factors include problems falling asleep or the subjective feeling that sleep is not restful. About half of those subjectively affected have consulted a doctor. Older people and people living alone are particularly affected. There is no doubt that sleep abnormalities can lead to poor performance throughout the day, physical/somatic illnesses, psychological problems, or even premature death. Prevention, early detection, and therapy support are relevant factors impacting the personal quality of life. The presented approaches have different application domains but share standard methodologies and technologies. Cross-domain thinking and application are essential to successful data acquisition and processing, either with traditional or cutting-edge approaches

Contactless Technologies, Sensors, and Systems for Cardiac and Respiratory Measurement during Sleep: A Systematic Review

Sleep is essential to physical and mental health. However, the traditional approach to sleep analysis—polysomnography (PSG)—is intrusive and expensive. Therefore, there is great interest in the development of non-contact, non-invasive, and non-intrusive sleep monitoring systems and technologies that can reliably and accurately measure cardiorespiratory parameters with minimal impact on the patient. This has led to the development of other relevant approaches, which are characterised, for example, by the fact that they allow greater freedom of movement and do not require direct contact with the body, i.e., they are non-contact. This systematic review discusses the relevant methods and technologies for non-contact monitoring of cardiorespiratory activity during sleep. Taking into account the current state of the art in non-intrusive technologies, we can identify the methods of non-intrusive monitoring of cardiac and respiratory activity, the technologies and types of sensors used, and the possible physiological parameters available for analysis. To do this, we conducted a literature review and summarised current research on the use of non-contact technologies for non-intrusive monitoring of cardiac and respiratory activity. The inclusion and exclusion criteria for the selection of publications were established prior to the start of the search. Publications were assessed using one main question and several specific questions. We obtained 3774 unique articles from four literature databases (Web of Science, IEEE Xplore, PubMed, and Scopus) and checked them for relevance, resulting in 54 articles that were analysed in a structured way using terminology. The result was 15 different types of sensors and devices (e.g., radar, temperature sensors, motion sensors, cameras) that can be installed in hospital wards and departments or in the environment. The ability to detect heart rate, respiratory rate, and sleep disorders such as apnoea was among the characteristics examined to investigate the overall effectiveness of the systems and technologies considered for cardiorespiratory monitoring. In addition, the advantages and disadvantages of the considered systems and technologies were identified by answering the identified research questions. The results obtained allow us to determine the current trends and the vector of development of medical technologies in sleep medicine for future researchers and research

Determination of accelerometer sensor position for respiration rate detection : Initial research

Continuous monitoring of a patient's vital signs is essential in many chronic illnesses. The respiratory rate (RR) is one of the vital signs indicating breathing diseases. This article proposes the initial investigation for determining the accelerometric sensor position of a non-invasive and unobtrusive respiratory rate monitoring system. This research aims to determine the sensor position in relation to the patient, which can provide the most accurate values of the mentioned physiological parameter. In order to achieve the result, the particular system setup, including a mechanical sensor holder construction was used. The breathing signals from 5 participants were analyzed corresponding to the relaxed state. The main criterion for selecting a suitable sensor position was each patient's average acceleration amplitude excursion, which corresponds to the respiratory signal. As a result, we provided one more defined important parameter for the considered system, which was not determined before

A triangle-shape region of interest in cardiorespiratory estimation during sleep monitoring

Introduction: With advancements in sensor and communication technologies, sleep monitoring is moving out of specialized clinics and into everyday homes. Extracting sleep-related data using far less complicated tools and procedures is possible than polysomnography. Respiratory and cardiovascular data are extracted from the signals such as the electrocardiogram (ECG), photoplethysmogram (PPG), and ballistocardiogram (BCG) to identify the aberrant respiratory events of apnea/hypopnea as well as to estimate sleep parameters. However, due to the different sleeping positions, such systems lack accuracy and/or complicated sensor network topology. In this work, we proposed an optimal topology of forcesensitive resistor (FSR) sensors to simplify the system design by identifying the region of interest for estimating cardiorespiratory parameters with minimal error. The sensors are deployed under the mattress and located on the bed frame. Methods: We proposed a low-cost, unobtrusive, non-invasive, and reliable solution with robust signal processing algorithms for cardiorespiratory measurements and automatic signal validation based on signal quality. The solution is established based on a multi-physical layer (MPL) and sensor interfaces coping with the embedded system’s specifications, and signal processing is performed onboard with two independent and simultaneous pipelines for heart rate and respiratory rate using discrete wavelet transform (DWT) and bandpass filter, respectively. Results: We identified the three most contributing FSR sensors forming a triangle shape covering the left upper side of the subject (in the supine position) as the region of interest. We reduced the mean absolute error (MAE) to as low as 3.94 and 2.35 for heart rate and respiratory rate. Conclusions: The approach with the topology of triangle-shaped performs appropriately in estimating the cardiorespiratory parameters in all four regular sleeping positions, i.e. supine, prone, left lateral, and right lateral

Introducing a conceptual method of sleep-related parameters measurement based on the sensors fusion and forcecardiography

Sleep is a multi-dimensional influencing factor on physical health, cognitive function, emotional well-being, mental health, daily performance, and productivity. The barriers such as time-consuming, invasiveness, and expense have caused a gradual shift in sleep monitoring from traditional and standard in-lab approach, e. g., polysomnography (PSG) to unobtrusive and noninvasive in-home sleep monitoring, yet further improvement is required. Despite an increasing interest in fiberoptic-based methods for cardiorespiratory estimation, the traditional mechanical-based sensors consist of force-sensitive resistors (FSR), lead zirconate titanate piezoelectric (PZT), and accelerometers yet serve as the dominant approach. The part of popularity lies in reducing the system’s complexity, expense, easy maintenance, and user-friendliness. However, care must be taken regarding the performance of such sensors with respect to accuracy and calibration